Improved clustering using deterministic annealing with a gradient descent technique

نویسندگان

  • G. Qiu
  • Martin R. Varley
  • Trevor J. Terrell
چکیده

Various techniques exist to solve the non-convex optimization problem of clustering. Recent developments have employed a deterministic annealing approach to solving this problem. In this letter a new approximation clustering algorithm, incorporating a gradient descent technique with deterministic annealing, is described. Results are presented for this new method, and its performance is compared with the K-means algorithm and a previously used deterministic annealing clustering algorithm. The new method is shown to produce more effective and robust clustering.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Data visualization by multidimensional scaling: a deterministic annealing approach

Multidimensional scaling addresses the problem how proximity data can be faithfully visualized as points in a low-dimensional Euclidean space. The quality of a data embedding is measured by a stress function which compares proximity values with Euclidean distances of the respective points. The corresponding minimization problem is non-convex and sensitive to local minima. We present a novel det...

متن کامل

Multidimensional Scaling by Deterministic Annealing

Multidimensional scaling addresses the problem how proximity data can be faithfully visualized as points in a low-dimensional Euclidian space. The quality of a data embedding is measured by a cost function called stress which compares proximity values with Euclidian distances of the respective points. We present a novel deterministic an-nealing algorithm to eeciently determine embedding coordin...

متن کامل

An Efficient MRF Image- Restoration Technique Using Deterministic Scale-Based Optimization

• A method for performing piecewise smooth restorations on images corrupted with high levels of noise has been developed. Based on a Markov Random Field (MRF) model, the method uses a neural network sigmoid nonlinearity between pixels in the image to produce a restoration with sharp boundaries while providing noise reduction. The model equations are solved with the Gradient. Descent Gain Anneal...

متن کامل

Finding prototypes for nearest neighbour classification by means of gradient descent and deterministic annealing

Abstraet--A new method is presented to find prototypes for a nearest neighbour classifier. The prototype locations are opfimised through a gradient descent and a deterministic annealing process. The proposed algorithm also includes an initialisation strategy which alms to provide the maximum classification rate on the training set with the minimum number of prototypes. Experiments show the effi...

متن کامل

V Annealing by Stochastic Neural Networks for Optimization

Two major classes of optimization techniques are the deterministic gradient methods and stochastic annealing methods. Gradient descent algorithms are greedy algorithms, which are subject to a fundamental limitation of being easily trapped in local minima of the cost function. Hopfield networks usually converge to a local minimum of energy function. Because of its deterministic input-output rela...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • Pattern Recognition Letters

دوره 15  شماره 

صفحات  -

تاریخ انتشار 1994